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(g) Coded modulation with unequal error protection. 

(57) Digital signals (from 101), such as digitized 
television signals, are subjected to a source 
coding step (by 104) followed by a channel 
mapping step (by 114 and 115). The source 
coding step causes the signal to be represented 
by first and second data streams (on 105, 106). 
The first stream carries data regarded as more 
important and the second carries data regarded 
as less important In the channel mapping step, 
the mapping is such that the data elements of 
the various data streams have differing probabi- 
lities of being erroneously detected at the re- 
ceiver. The channel mapping step includes at 
least one multi-level coding step. The signal 
constellations used in the channel mapping 
step are partitioned into supersymbols, in which 
the distance between the symbols comprising 
at least ones of the supersymbols is less than a 
parameter referred to as the maximum intra- 
subset distance (MID). Additionally, in some 
constellations, the minimum distance between 
at least ones of the symbols of at least one of 
the supersymbols is greater than die minimum 
distance between the symbols of the constel- 
lation as a whole while, again, still being less 
than the MID. The first data stream is used to 
identify a sequence of supersymbols, while the 
second data stream is used to select particular 
symbols from the identified supersymbols. 
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Background of the Invention 

of dillS H r r/ nt h in h entl ° n ^^V 0 transmisslon of di 9 jtal data including, particularly, the transmission 
of digital data which represents television (TV) signals. 

nf Jl iS 9er T ? a ? know,edged that some f0 ™ 0, di9ital transmission will be required for the next generation 
of television technology, conventionally referred to as high definition television, or HDTV. This requiremen t 

due mostly to the fact that much more oow*rf.,i v.h™ r^r^; u 1- . . 11 qUirement ,s 

■ , . ... • "f owiicnica odn uts irnuiemeniea witn aiaitai 

Srrrj,^ r?i 09 gnal processing - However> there has been s ° me 

commuted to an all-d.g.tal transmiss,on system because of the potential sensitivity of digital transmission to 
small variations m s.gnal-to-noise ratio, or SNR, at the various receiving locations nsm.ss.on to 

«. P"; e " on1er,on - sometime s ^ferred to as the "threshold effect"-can be illustrated by considering the 
case of too te ev.s.on recovers that are respectively located at 50 and 63 miles from a television bmadcast 

ZIt „™ ,h f VTt I" am ° Unt ° f Si9nal P ° Wer reCeiV6d b * the te,evision is about 2 dB 

£SS i f 9,tal ,ransm,ssion scheme is us ed and that transmission to the receiver that is 50 miles 

distant exhibrts a b,t-error rate of 1 0*. If the 2 dB of additional signal loss for the other TV set translated 

t ° f the SNR 3t the inpUt ° f the receiver ' then this recei ^ will operate with bSTrS rate of 

21t h these t kinds of bit - error ^es. ^e TV set that is 50 miles away would have a very go S ri 

ZlrfnrmS ""TZ ^ W S< " W ° U ' d pr ° bab,y be very poor - ™ s kind of *** degradation 
.n performance over short d.stances is generally not considered acceptable by the broadcasting industry Bv 

-mpanson, the degradation in performance for Present.y used ana.o^ TV tranLission schemes iTlfhUre 

nnl^- iS ^u, req o r 1 d 3 di9ita ' transmission scheme adaptable for use in television applications which over- 
comes th.s problem. Solutions used in other digital transmission environments-such as the use ofTreZ- 

T^Z PP TT^'T dear,y inapp,icable 10 the free -^ce broadcast environment of television, 
air b^dt^o Th t f*™*? far | °« room «n8 the shortcomings of standard digital transmission forover-the- 
f"? ™ S '9 nals ~ referred to herein genetically as "unequal-error-protection signaling"- 
a t partlCU,artyp « of source codi "9 *tep followed by a particular type of ch rnnel mapping step. More 

v h!.e T h; oh T 9 SteP 030868 * ^ te,eViSi0n Si9nal t0 be rented by two or more data streams 
uhile ,n the channel mapp.ng step, the mapping is such that the data elements of the various data streams 

reZf T^l ° f CbanneWnduced d ^rent Probabilities of being erroneL JjSS 

at the recerver. I.ustrat.vely, a f ,rst one of the aforementioned data streams carries components of the overaM 
te.evis.on s,gna. wh.ch are regarded as the most important-for examp.e, the audio, the framing in orma^on 
and the vrtal port.ons of the video information-and that data stream is mapped such that its da ta etemente 
have the lowest probability of channel-induced error. A second one of the data streams ^ca n^fcomDonenS 

m *ZT te,evision T al which are regarded as ,ess important tha " «— cSSIZS 

TJZl fh r r* that ^ ^ e,ementS haVS 3 pr ° babi,it y of channel-induced error thatTs not 

as low as those of the f.rst data stream. In general, it is possible to represent the overall television signal with 
any number of data streams, each carrying components of varying importance and each hav ng a rasped 
probabil.ty of error. This approach allows a graceful degradation in reception quality at the TV settocX fZ 
cause as the b.terror rate at the receiver begins to increase with increasing distance from the broadci trans^ 

teJ^T^^T impleme , nt f the above-described overall concept in which different levels of error pro- 

Irovlf^h w • ,fferent 0,38868 ° f d3ta e,ementS 9enerated b * 'he s^rce encoding step, but whict 
prov.des enhanced no.se .mmunity via the use of coded modulation, such as trellis-coded modulation thesym- 
bols in a predetermined 2N-dimensional channel symbol constellation. N £ 1, are divided into groups eaSTf 
wh.ch.s referred to as a "supersymbol." During each of a succession of symbol intervals, ^predetermined I num- 
ber of the mos .mportant data elements are channel encoded, and the resulting channel coded date etement 
.dentrfy a part.cu arone of the supersymbols. The remaining data elements, which may also be cnann2 et 
coded are used to select for transmission a particular symbol from the identified supersymbol 

in t^H^TJl H hUS H fa L deS< ? bed I" 8imilar 3 9eneral W3y tG conve nt-onal coded modulation schemes 
.n that he "alter also dn/.de the channel symbols into groups, typically referred to as "subsets " However in 
convent,onal coded modulation schemes, the subsets are formed under the constraint that the minium e" 
clKJeand-stance^eremafter referred to as the "minimum distance") between the symbols in a subTetbqreater 
than the m.n.mum distance between the symbols in the constellation as a whote^ the des^ibS ^approach 
however, the m.n.mum distance between the symbols of a supersymbol is the same as the Smum dZnJe 
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between the symbols in the constellation as a whole. This distance property allows for greater amount of noise 
immunity for the most important data elements than for the other data elements, that immunity being optimized 
by keeping the minimum distance between supersymbols as large as possible-usually greater than the mini- 
mum distance between the symbols of the constellation. Specifically, once the supersymbols are defined, it 
is possible to design codes for the most important data elements based on the distances between the super- 
symbols, i.e., as though each supersymbol were a conventional symbol in a conventional constellation. This 
being so, a particular degree of noise immunity can be achieved for the most important data elements that is 
greater than what can be achieved for the other data elements. 

Summary of the Invention 

The present invention provides a new class of signal constellations that can be used in unequal error pro- 
tection signaling schemes of the type taught in the aforementioned Wei patent application. Advantageously, 
the availability of such constellations provides the designer of unequal error protection signaling schemes with 
additional flexibility in meeting desired design criteria such as particular different combinations of a) percen- 
tage of most important data elements, b) degree of overall code redundancy, d) coding gains, etc. In particular, 
in these new constellations, the minimum distance between at least ones of the symbols of at least one of the 
supersymbols is a) greater than the minimum distance between the symbols of the constellation as a whole, 
while being b) less than a parameter defined herein as the "minimum intra-subset distance (MID)-which is in 
contradistinction to the subset arrangements of standard equal error protection signaling schemes. 

In accordance with a feature of the invention, the probability that the less Important data element values 
will be decoded properly is enhanced by a particular scheme for assigning less important data element values 
to particular symbols within a supersymbol. In particular, a pair of symbols from respective different super- 
symbols are assigned to the same less important data element values if the distance between that pair of sym- 
bols is the minimum distance between any pair of symbols of those two supersymbols. 

Brief Description of the Drawing 

In the drawing, 

FIG. 1 is a block diagram of a transmitter in which the present invention can be used; 

FIG. 2 is a block diagram of a receiver for transmitted signals transmitted by the transmitter of FIG 1 ; 

FIG. 3 depicts a prior art signal constellation; 

FIG. 4 depicts a signal constellation having supersymbols; 

FIGS. 5 and 6 show multi-level coders useful in the transmitter of FIG. 1 ; 

FIGS. 7 and 9 depict signal constellations that can be used by the transmitter of FIG. 1 in accordance with 
the principles of the invention; 

FIG. 8 depicts a signal constellation of the type typically used in equal error protection schemes; 

FIGS. 9-14 depict further signal constellations that can alternatively be used by the transmitter of FIG. 1 ; 

and 

FIGS. 15 and 16 show illustrative multi-stage decodes used in the receiver of FIG. 2. 
Detailed Description 

Before proceeding with a description of the illustrative embodiments, it should be noted that various ones 
of the digital signaling concepts described herein are all well known in. for example, the digital radio and voi- 
ceband data transmission (modem) arts and thus need not be described in detail herein. These include such 
concepts as multidimensional signaling using 2N-dimensional channel symbol constellations, where N is some 
integer, trellis coding; scrambling; passband shaping; equalization; Viterbi. or maximum-likelihood, decoding; 
etc. These concepts are described in such U.S. patents as U.S. 3,810,021, issued May 7, 1974 to I. Kalet et 
al.; U.S. 4,015,222, issued March 29, 1977 to J. Werner, U.S. 4,170,764, issued October 9, 1979 to J. Salz et 
al.; U.S. 4,247,940, issued January 27, 1 981 to K. H. Mueller et al.; U.S. 4,304,962, issued December 8, 1981 
to R. D. Fracassi et al.; U.S. 4,457,004, issued June 26, 1984 to A. Gersho et al.; U.S. 4,489,418, issued De- 
cember 18, 1984 to J. E. Mazo; U.S. 4,520,490, issued May 28, 1985 to L. Wei; and U.S. 4,597,090, issued 
June 24, 1986 to G. D. Forney, Jr. 

It may also be noted before proceeding that various signal leads shown in the FIGS, may carry analog 
signals, serial bits or parallel bits, as will be clear from the context 

Turning now to FIG. 1, television (TV) signal source 101 generates an analog video signal representing 
picture information or "intelligence," which signal is passed on to source encoder 104. The latter generates a 
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digital signal comprised of data elements in which at least one subset of the data elements represents a portion 
of the information, or intelligence, that is more important than the portion of the information, or intelligence, 
represented by the rest of the data elements. Illustratively, each data element is a data bit, with an average 
m+k information bits being generated for each of a succession of symbol intervals. The symbol intervals are 
5 comprised of N signaling intervals, where 2N is the number of dimensions of the constellation (as described 
below). The signaling intervals have duration of T seconds and, accordingly, the symbol intervals each have 
a duration of NT seconds. The embodiments explicitly disclosed herein haDDen to use two-dimensional rnn. 
stellations, i.e., N = 1 . For those embodiments, then, the signaling intervals and the symbol intervals are the 
same. 

w Of the aforementioned m+k information bits, the bits within the stream of m bits per symbol interval, ap- 

pearing on lead 105, are more important than the bits within the stream of k bits per symbol interval, appearing 
on lead 106. 

The bits on leads 105 and 106 are independently scrambled in scramblers 110 and 111, which respectively 
output m and k parallel bits on leads 112 and 113. (Scrambling is customarily earned out on a serial bit stream. 
15 Thus although not explicitly shown in FIG. 1, scramblers 110 and 111 may be assumed to perform a parallel- 
to-serial conversion on their respective input bits prior to scrambling and a serial-to- parallel conversion at their 
outputs.) The signal is then channel mapped. In particular, the respective groups of bits on leads 112 and 113 
are extended to channel encoders 114 and 115 which generate, for each symbol interval, respective expanded 
groups of r and p bits on leads 121 and 122, where r > m and p > k. The values of those bits jointly identify a 
20 particular channel symbol of a predetermined constellation of channel symbols (such as the constellation of 
FIG. 4 as described in detail hereinbelow). Complex plane coordinates of the identified channel symbol are 
output by constellation mapper 1 31 , illustratively realized as a lookup table or as a straightforward combination 
of logic elements. Conventional passband shaping and television modulation are then performed by passband 
shaper 141 and television modulator 151, respectively. The resultant analog signal is then broadcast via an- 
25 tenna 152 over a communication channel, in this case a free-space channel. 

It will be useful at this point to digress to a consideration of FIG. 3. The latter depicts a standard two-di- 
mensional data transmission constellation of the type conventionally used in digital radio and voiceband data 
transmission systems. In this standard scheme-conventionally referred to as quadrature-amplitude modula- 
tion (QAM)-data words each comprised of four information bits are each mapped into on -of 16 possible two- 
30 dimensional channel symbols. Each channel symbol has an in-phase, or I, coordinate on the horizontal axis 
and has a quadrature-phase, or Q, coordinate on the vertical axis. On each axis, the channel symbol coordin- 
ates are ± 1 or ± 3 so that the distance between each symbol and each of the symbols that are horizontally 
or vertically adjacent to it is the same for all symbols -that distance being "2". As a result of this uniform spac- 
ing, essentially the same amount of noise immunity is provided for all four information bits. 
35 As is well known, it is possible to provide improved noise immunity without sacrificing bandwidth efficiency 

(information bits per signaling interval) using a coded modulation approach in which an "expanded" two-di- 
mensional constellation having more than (in this example) 16 symbols is used in conjunction with a trellis or 
other channel code. For example, one can use a 32-symbol, two-dimensional constellation together with an 
8-state trellis code to achieve approximately 4 dB of enhanced noise immunity over the uncoded case of FIG. 
40 3, while still providing for the transmission of four information bits per signaling interval. Here, too, however, 
essentially the same amount of noise immunity is provided for ail four information bits. 

Moreover, it is known that the noise immunity and bandwidth efficiency advantages of coded modulation 
can be achieved while providing different levels of protection against channel-induced error for different class- 
es of bits. Specifically, it is possible to achieve a level of error protection for a class of most important bits which 
45 is substantially greater than what can be achieved with the aforementioned conventional coded modulation 
approach. Indeed, the transmitter of FIG. 1 embodies that concept, as will now be described in further detail. 

The constellation used in the transmitter of FIG. 1 is illustratively the two-dimensional 32-symbol constel- 
lation shown in FIG. 4. The symbols in the signal constellation are divided into groups referred to as "super- 
symbols." Specifically, the constellation of FIG. 4 is divided into 2 r = 2 2 = 4 supersymbols. In this example, the 
so points in the four quadrants constitute respective supersymbols, as denoted by a box enclosing each group. 
The supersymbols are denoted generically as Cl bJh where b 4 = 0,1 and 6 3 = 0,1. The four supersymbols are 
thus Oqo, Clo U Q 10 , and Q^. 

In this example, m = 1.625 and k = 2.125 so that the overall bit rate is 3.75 bits per symbol with 43.33% 
of the bits being in the class of most important bits. (The manner in which such fractional average bit rates 
can be achieved in practice will become clear as this description continues.) Encoder 114 adds an average 
0.375 redundant bits for every 1 .625 bits that are input to encoder 1 14 so that r = 2. Encoder 115 adds an aver- 
age 0.875 redundant bits for every 2.125 bits that are input to encoder 115 so that p = 3. The r = 2 bits on lead 
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121 identify one of the four supersymbols and the p = 3 symbols on lead 122 select a particular one of the 
eight channel symbols within the identified supersymbol. The partitioning of the constellation is such that the 
minimum distance between the symbols of a supersymbol-that distance being denoted as d 2 in FIG. 4— is the 
same as the minimum distance between the symbols in the constellation as a whole. Given this characteristic, 
increased noise immunity for the most important bits can be provided via appropriate selection of a) the codes 
implemented by encoders 114 and 115 and b) the ratio oycfe-- where 6^ is the minimum distance between the 
supersymbols. (The parameter d, is given by the minimum of the distances between all the pairs of supersym- 
bols. with the distance between any pair of supersymbols being the minimum distance between any symbol 
of one of the pair of supersymbols and any symbol of the other.) 

Specifically, a coded modulation scheme can now be constructed for the most important bits as though 
the four supersymbols were four conventional symbols in a conventional constellation. To design such a coded 
modulation scheme, the four supersymbols are partitioned, as is conventional, into a predetermined number 
of subsets. In this case, there are two subsets, where the value of d 3 denotes which subset each of the su- 
persymbols belongs to. Thus, one subset, referred to as subset "0", comprises supersymbols Qqo and O 10 and 
the other, referred to as subset "1", comprises supersymbols Qq^ and n n . An appropriate code is used to en- 
code the most important input bits to generate a stream of coded output bits which a) define a sequence of 
these subsets and b) for each subset of the sequence, select a particular supersymbol within that subset The 
less important bits are then used to select for transmission a particular symbol from each of the thus-selected 
supersymbols. In this example, as already seen, this latter selection also involves the use of coded modulation. 

At least one of the channel encoders of the transmitter of FIG. 1 implements a multi-level code. In this 
example, in particular, both of them do. As noted earlier, a multi-level code is one in which the data elements- 
-in this embodiment, bits— to be coded are divided into two or more substreams. Each of one or more of the 
substreams is then individually redundancy coded using a code of any desired type. The individual encoded 
substreams-along with any substreams that were left uncoded-form the output of the multi-level code. 

Particular illustrative embodiments for encoders 114 and 115 are shown in FIGS. 5 and 6, respectively. 
Encoder 114 implements a two-level code and, as such, includes two coders— coders 1141 and 1142. The re- 
dundancy code implemented by coder 1141 is a conventional rate R = 7/8 zero-sum parity check code such 
as shown in G. C. Clark, Jr. and J. B. Cain, Error-Correct i-on Coding for Digital Communications (New York: 
Plenum, 1981). The redundancy code implemented by coder 1142 is a conventional rate R = 3/4 punctured 
convolutional code such as shown in Y. Yasuda et al, "High-rate punctured convolutional codes for soft decision 
Viterbi decoding.* IEEE Trans. Comm. . Vol. COM-32, 1984, pp. 315-318. In operation, a serial-to- parallel (S/P) 
converter 1144 within encoder 114 takes in 13 bits over 8 symbol intervals, yielding an average input bit rate 
of m = 1 .625 bits per symbol interval as noted earlier. The output of converter 11 44 comprises two substreams 
of bits. In one substream, the bits are provided in parallel groups of seven to coder 1 141 . In the other substream, 
the bits are provided in parallel groups of six to coder 1142. For every group of seven input bits, coder 1141 
generates eight output bits which are applied to 8-bit buffer 11 47. At the same time, for every group of six input 
bits, coder 1142 generates eight output bits which are applied to 8-bit buffer 1148. The contents of buffers 1147 
and 1148 are read out synchronously in such a way that a pair of bits-one from each of the two buffers-is 
provided on lead 121 for each symbol interval. These bits are the aforementioned bits b 3 and b 4 . As such, the 
former identifies one of the two subsets "0" and "1" and the other identifies one of the two supersymbols from 
the identified subset, the two bits b 3 and b 4 thus identifying one of the four supersymbols fioo, f^, n 10 and 
Oil- 

Encoder 115 implements a three-level code and. as such, includes coders 1151, 1152 and 1153. Coders 
1151 and 1152 implement the same codes that are implemented by coders 1141 and 1142, respectively. Coder 
1153 implements a rate R = 1/2 convolutional code such as shown in the aforementioned Clark and Cain text. 
In operation, a serial-to-parallel (S/P) converter 1154 takes in 17 bits over 8 symbol intervals, yielding an aver- 
age input bit rate of k = 2.125 bits per symbol interval, as noted earlier. The output of converter 1154 comprises 
three substreams of bits. In one substream, the bits are provided in parallel groups of seven to coder 1151. In 
the second stream, the bits are provided in parallel groups of six to coder 1152. In the third group, the bits are 
provided in parallel groups of four to coder 1153. For every group of seven input bits, coder 1151 generates 
eight output bits which are applied to 8-bit buffer 1157. For every group of six input bits, coder 1152 generates 
eight output bits which are applied to 8-bit buffer 1158. For every group of four input bits, coder 1153 generates 
eight output bits which are applied to 8-bit buffer 1159. 

The contents of buffers 1157, 1158 and 1159 are read out synchronously in such a way that three bits- 
one from each of the three buffers-are provided on lead 122 for each symbol interval. These three bits- 
denoted 62, Oi and b 0 ~ select a particular symbol from the supersymbol identif ied at the output of encoder 114. 
To this end, each of the symbols in the constellation is labelled with a three-bit label as shown in FIG. 4. These 
three bits are, in fact, the aforementioned bits o 2 , 0i and b 0 . 
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The symbols of each supersymbol are partitioned at a first level of partitioning into two subsets. Each sub- 
set is comprised of four symbols as denoted by the labelled b 0 value. Thus one subset is comprised of the four 
symbols denoted 000, 010, 100 and 110 and the other subset is comprised of the four symbols denoted 001, 
011, 101 and 111. The symbols of each of these subsets are partitioned ata second level of partitioning into 
5 two second-level subsets, which are identified by their labelled o 0 and 6 t values. Each second-level subset is 
comprised of two symbols identified by 62- 

The assignment of three-bit labels to the svmbols of ear.h 
implemented by coders 1151, 1152 and 1153 are selected taking Into account the minimum distance 
the subsets at each level of partitioning. In particular, the most powerful, i.e., lowest-rate, code-in this case 
10 the rate R = 1/2 code implemented by coder 1153-is used at the first level of partitioning to generate b 0 be- 
cause the minimum distance between the subsets at the first level is the smallest, that distance being oV The 
second- and least-powerful codes, the rate R = 3/4 and rate R = 7/8 codes implemented by coders 1152 and 
1151, respectively, generate b, and o 2 , respectively, because the minimum distance between the second-level 
subsets is greater by a factor of <2 than that of the first level minimum distance whereas the minimum distance 
between the symbols in each second-level subset is greater by a factor of 2 than the first-level minimum dis- 
tance. 

The advantages provided by such use of multi-level codes in an unequal error protection signaling scheme 
are discussed hereinbelow. First, however, reference is made to the receiver of FIG. 2. 

In particular, the analog broadcast signal is received by antenna 201 ; subjected to conventional television 
front-end processing in processing unit 211 including, for example, demodulation; and converted to digital form 
by A/D converter 212. The signal is then equalised by passband channel equaliser 221, which generates a 
signal representing the equaliser's best estimate as to the I and Q component values of the transmitted symbol. 
This estimate, which is referred to hereinbelow as the "received symbol signal," is passed on parallel rails 222 
and 223 to be channel decoded by channel decoders 231 and 232. The function of channel decoder 231 is to 
identify the most likely sequence of supersymbols, while the function of channel decoder 232 is to identify the 
most likely sequence of symbols, given that sequence of supersymbols. The output of decoder 232 on lead 
234 thus comprises the bits 6 3 and o 4 , while the output of decoder 231 on lead 233 thus comprises the bits 
Do* by and b^. 

Since the streams of most- important and less-important bits are, in this embodiment, bottrr wlti-level cod- 
ed, the channel decoders 231 and 232 must each be multi-level decoders. Straightforward maximum likelihood 
decoding, such as a Viterbi decoding, could be employed for this purpose. However, the present illustrative 
embodiment uses a more refined approach to multi-level decoding-an approach referred to as multi-stage de- 
coding. This is a well-known technique, the details of which can be found in A. R. Calderbank, "Multilevel codes 
and multistage decoding," IEEE Trans. Comm.. Vol. COM-37, pp. 222-29, 1 989, hereby incorporated by refer- 
ence. For present purposes, then, it suffices to summarize, in overview, how the multi-stage decoding is car- 
ried out. 

In particular, channel decoder 232 first recovers the bits encoded by coder 1142 within encoder 114 (FIG. 
5), independent of, and without reference to, any decoding performed on the bits encoded by coder 1141. To 
this end, as shown in FIG. 15, decoder 232 includes decode b 3 circuitry 2321, decode o 4 circuitry 2323 and 
40 delay element 2322. In operation, the received symbol signal is processed by circuitry 2321 to decode bit b 3 

by first finding the symbol closest to the received signal symbol-and the associated metrics-in (n 0 i v 
and in (ftoo v «io)- The trellis path is then extended as per conventional Viterbi decoding of the code imple- 
mented by coder 1142 (FIG. 5) to generate a final decision about a previously encoded information bit that 
45 was encoded by that coder. The decoded bit-one of the original most important bits-is provided as an output 
on lead 234. It is also re-encoded within circuitry 2321 using the code of coder 11 42 to provide bit o 3 to circuitry 
2323 as well as to channel decoder 231 (FIG. 16), as described below, via lead 236. A version of the received 
symbol signal is delayed by delay element 2322 by a time sufficient to provide the value of bit 6 3 as just de- 
scribed. That signal is then provided to circuitry 2323 along with bit 6 3 to circuitry 2323 which then proceeds 
to decode bit b 4 . This is carried out, in particular, by first finding the symbol closest to the received signal sym- 
bol-and the associated metrics-in supersymbol in supersymbol n 1£v The metrics are stored in a buf- 

fer and are used to perform maximum likelihood decoding of the code implemented by coder 1141 (FIG 5) 
thereby to provide another of the most important bits on lead 234. At the same time, that bit is re-encoded 
within circuitry 2323 to provide bit b A to channel decoder 231 on lead 236. 

It may be noted at this point that, obviously, circuitries 2321 and 2323 must be provided within information 
about the constellation that is being used in order to carry out their respective functions. That information is 
illustratively stored in a constellation store 2325 whose output-denoted as "A'-is provided to both of those 
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circuitries, as well as to decoder 231 of FIG. 16.. 

With the most important bits now provided on leads 234 and the values of bits b 3 and 6 4 now being provided 
to decoder 231 on lead 236, the multi-stage decoding can now proceed-within the latter channel decoder- 
to recover the less important bits. To this end, as shown in FIG. 16, decoder 231 includes decode b Q circuitry 
2315, decode fc, circuitry 2316, decode ^ circuitry 2317, and delay elements 2311, 2312 and 2313. In oper- 
ation, the received symbol signal is delayed by an amount equal to the processing delay within decoder 232 
so that circuitry 2315 can be provided with bits b z and b 4 at the same time that it receives the received symbol 
signal. Circuitry 2315 then proceeds by first finding, within the supersymbol those symbols having 6 0 = 
0 and 6, = 1 which are respectively closest to the received signal symbol. The trellis path is then extended, 
as before, using the metrics associated with those two closest symbols, leading ultimately to a decoding of bit 
b 0 and hence a recovery of one of the less important bits. That bit is then re-encoded within circuitry 2315 so 
as to be able to provide the value of bit b 0 to circuitries 2316 and 2317. The latter operate in a manner similar 
to that described above with respect to the other decode circuitries to recover the other less important bits, 
with the delays of delay elements 2312 and 2313 being sufficient to enable each of the circuitries 2316 and 
2317 to receive the re-encoded bits, as needed. 

Decoding in the case where multi-dimensional symbols are used is carried out in a similar manner, as will 
be appreciated by those skilled in the art 

The bits output by decoder 231 and 232 on leads 233 and 234, respectively, are descrambled by descram- 
blers241 and 242, which respectively perform the inverse function of scramblers 110and 111 in the transmitter. 
A television signal formatted so as to be displayable by an appropriate television set is then generated from 
the descrambler outputs by source decoder 253, thereby recovering the original television information, or in- 
telligence. That signal is then presented to the television viewer on television set 260. 

The performance of the overall unequal error protection signaling scheme implemented by the system of 
FIGS. 1 and 2, as just described, can now be characterised in terms of the nominal coding gain (i.e., the coding 
gain at very low error rates), this being the gain in signal-to-noise ratio over that of an uncoded 1 6-QAM system. 
The gain for the most important bits is 6.24 dB and for the less important bits is 2.70 dB when the number of 
states of each of the convolutional codes is chosen to be 16. The unique advantage of using multi-level coding, 
however, does not wholly lie with the particular levels of coding gain achieved. Unequal error protection sig- 
naling schemes that do not use multi-level coding may achieve comparable, or even better, coding gain results 
in particular applications. However, the use of multi-level coding is particularly advantageous is in its ability 
to provide the system designer with a greatly enhanced capability to pick the desired performance criteria, 
given the application, and to then readily arrive at a coding scheme which meets those criteria. 

For example, the overall data rate of the above-described system can be increased from 3.75 to 3.875 
bits per symbol without affecting the coding gain by changing the code implemented by coders 1141 and 1151 
to a rate R = 15/16 zero-sum parity check code (and using 16-bit, rather than 8-bit, buffers in the encoders). 
(At the same time, the percentage of most important bits increases ever so slightly-from 43.33% to 43.55%.) 
As another example, the percentage of most important bits can be reduced to 34.375%, while at the same 
time increasing the level of error protection afforded to those bits by a) changing the codes implemented by 
coders 1141, 1142, 1152 and 1153, to respectively, a rate R = 7/8 punctured convolutional code; a rate R = 3/4 
convolutional code; a rate R = 7/8 zero-sum parity check code; and a rate R = 3/4 convolutional code; and b) 
eliminating coder 1151 so that the bits applied to buffer 1157 are uncoded bits. This arrangement achieves 
coding gains of 8 dB for the most important bits and 0.22 dB for the less important bits. Additionally, by changing 
the ratio of djd y in FIG. 4, one can trade off the gains of the most important and less important bits. It will 
thus be seen that the use of multi-level coding allows for the use of a virtually unlimited range of design para- 
meters-including the code rates, code complexity, overall coding redundancy, fraction of that redundancy used 
for error protection of the most important bits (as opposed to that used for the less important bits)-in order 
to meet desired system design criteria. This flexibility can be further enhanced by using various different signal 
constellations, including constellations having various different numbers of symbols, symbol spacings, super- 
symbol groupings and subset partitionings. 

Indeed, the present invention provides a new class of constellations which may be advantageously used 
to provide the system designer with even further flexibility. 

The constellations embodying the principles of the present invention are characterized by particular dis- 
tance relationships within the constellation. Indeed, an important parameter in the design of coded modulation 
schemes is the so-called intra-subset distance. This parameter is the minimum distance between any two sym- 
bols in the subset. In coded modulation schemes which, unlike in the present invention, seek to provide equal 
error protection, the design constraint is to partition the constellation into subsets in such a way as to maximize 
the minimum of the intra-subset distances taken across all the subsets. This value, which we define as the 



30 



35 



40 



45 



50 



55 



7 



BNSDOCID: <EP 054O232A2_I_> 



EP 0 540 232 A2 

"maximum intra-subset distance," or MID, has been achieved when, given a particular partitioning, any further 
attempt to increase the intra-subset distance of any particular subset (by making any other symbol-to-subset 
assignment changes) would not result in a further increase in the aforesaid minimum value. 

Further, an important distinction between equal error protection and unequal error protection schemes 
5 needs to be kept in mind. In the former, the error protection for the so-called coded bits is determined by the 
minimum distance between subset sequences while the error protection for the uncoded bits is determined 
by the minimum distance between the symbols within a subset. Designers of equal -error- protect Ion schemes 
want these two minimums to be as close to each other as possible because they want equal error protection 
for ail the data. The performance of these schemes is dominated by the distance between the symbols within 
10 a subset This results from the fact that one can always increase the complexity of the code in order to achieve 
whatever distance is desired between subset sequences. 

In the case of unequal error protection, by contrast, the symbols in a supersymbol are selected by the 
less important bits. Thus the distance between these symbols can be significantly less than the MID. Indeed 
it is limited only by the distance between the symbols of the constellation as a whole. This distance is chosen 
to provide the necessary level of error protection for the less important bits. Once we fix that distance, then 
the subset partitioning can be done to take advantage of this fact, thus making possible the realization of great- 
er distances between the supersymbol sequences than would be possible with conventional coded modulation 
for the same complexity. We are, thus, no longer constrained to keep the symbols within a supersymbol far 
away from each other. 

Taking the foregoing into account, constellations useful in unequal-error -protection signaling schemes are 
characterized by the fact that the minimum distance between at least some of the symbols of at least one of 
the supersymbols is less than the MID. Constellations of this general type are known. However, in the prior 
art, the minimum distance between the symbols of the supersymbols is the same as the minimum distance 
between the symbols of the constellation as a whole. By contrast, constellations embodying the principles of 
the present invention are not so constrained. That is, the minimum distance between at least ones of the sym- 
bols of at least one of the supersymbols is greater than the minimum distance between the symbols of the 
constellation as a whole while, again, still being less than the MID. Graphically speaking, constellations meet- 
ing this criterion will generally appear to have supersymbols which, at least to some degree, overlap (as do 
the subsets of the constellations used for equal error protection schemes). That is, at least one syr bol of a 
least one supersymbol will be closer to each of a pair of symbols of a different supersymbol than that pair of 
symbols are to each other. 

One illustrative, 32-symbol, constellation embodying the principles of the present invention is shown in 
FIG. 7. This constellation is partitioned into four supersymbols, the constituent symbols thereof being labelled 
A, B, C and D. respectively. The distance labelled as "X" can be, for example, "1", thereby providing a con- 
stellation whose individual symbols are uniformly spaced. Or "X" can be greater than one-such as V3~thereby 
increasing some of the inter-supersymbol distances. This provides an additional degree of design freedom in 
terms of achieving particular desired levels of error protection. 

The MID of the constellation of FIG. 7 is "2", which can be verified from a consideration of FIG. 8, in which 
the same constellation has been partitioned in order to provide equal error protection. That is the minimum 
40 distance between any two symbols labelled "A", for example, is, in fact, "2". In FIG. 7, by contrast, the corre- 
sponding minimum distance, in accordance with the invention, is less than "2". Specifically, it is V2. And note 
that, from a graphical perspective, subsets A and B overlap one another, as do subsets C and D. (It is thus 
not possible to draw a box around the supersymbols, as was done in FIG. 4.) 

Another illustrative constellation embodying the principles of the invention-this one having 64 symbols- 
-is shown in FIG. 9. Again, the constellation is partitioned into four supersymbols labelled using the same lab- 
elling convention as that used for FIG. 7. 

(FIGS. 10-14 show yet further constellations that can be used, although these particular constellations 
do not meet the dual distance criteria set forth hereinabove. The same labelling conventions as described 
above are used in these constellations and thus nothing further need be said about them.) 

The following two tables illustrate the tremendous flexibility provided by the combination of a) the use of 
multi-level coding and b) constellations embodying the principles of the invention in order to arrive at unequal- 
error-protection signaling schemes which provide various different combinations of a) percentage of most im- 
portant bits, b) degree of overall code redundancy, c) coding gains, and d) ratio of peak- to-average power 
(which is an important consideration in power-limited channels such as terrestrial and satellite telephone chan- 
nels). TABLE 1 is a table of codes in which 25% of the bits constitute the most important bits. TABLE 2 is a 
table of codes in which various other percentages of the bits constitute the most important bits. Note that 
among the various possibilities are implementations which use the constellations of FIGS. 7 and 9 embodying 
the principles of the invention. 
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TABLE 1 



Example 


Signal 
Constellation 


Code C 0 for 
important bits 


CodeC, for less 
important bits 


4A 

25% most important 
data 
rate4-l/L 


Fig. 10 

P — PAP — 1 ,T 

I 4, if ab = cd 
\ 1, if ab * cd 


12335): 16- 
state, rate 1/2 
conventional code 
* 2 (Co) - 11 
T = 7.4 db 


single parity check 
code with 
redundancy ML 
dHCt) = 2 

y = OdB 


4B 

25% most important 
data 
rate4-2/L 


Fig. 7 
P = 3.07, PAR = 1-7 

dHOatA^) * 

4, if ab = ?rf 
3, if ab = cd 
{ \ t if ab => cd 


[631]: 16- 
state, rate 1/2 
convolutional code 
d 2 (C 0 ) - 14 
r = 7.6 dB 


aui ijv«c puniy cnccc 
code over FF 4 
with redundancy 21 L 
<* 2 <C,)»4 
Y = 2.12 dB 


4C 

25% most important 
data 
rate 4 — 


Fig. 11 
P = 5.25. PAR = 1-7 

| 10, if ab = cd 
1 2, ifa^^crf 


(2335): see 
Example 4A 
* 2 (C 0 ) = 26 
T = 7.91 dB 


single parity check 

code with 
redundancy ML 
d\C t ) = 4 
Y = 0.21 dB 


4D 

25% most important 
data 
rate4-2/Z. 


Fig. 12 
/» = 11, PA* = 1 86 

rf 2 (n 0 .o,) = 25 


single parity check 

code with 
redundancy ML 
d 2 {C 0 ) = 50 
T = 7.54 dB 


[2335]: see 
Example 4 A 
& 

parity check 
rf 2 (C 0 ) = 14 
7= X20dB 


4E 

25% most important 
data 
rate4-i/Z, 


Fig. 9. 

/> = (4 + 24x+140x 2 )/32 

d 2 (a^ci a ) * 

1+x 2 , if ab = cd 
x 2 , if ab = cd 
1. if <rf> = c<* 
PA* = 2 -05 for x = 03 


x code T(dB) 
0.4 [23.35) 4.92 
0.3 [23,35] 6,11 
0.2 [ 23,35] 7.90 
0.1 [23,35] 10.10 


2- level code: see 
Example 4D 

d 2 {C Q ) = 14x 2 
£ T(dB) 
0.4 3.96 
0.3 3.25 
0.2 1.91 
0,10 -1.46 
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TABLE 2 

10 



15 



30 



35 



Example 


Signal 
Constellation 


Code C 0 for 
important bits 


Code Ci for less 
important bits 


4F 

50% important 
data 
rate4-l/£ 


Fig. 13 
P = 10.5. /Vlrt = 2-33 

5, if a6 = cd 
' 2 r ifab = cd 
[ 1, if ab = cd 


U31J: 16- 
stale, rale 1/2 
con volutional code 
d 2 (C 0 ) = 16 
T = 5.8 dB 


single parity check 
code with 
redundancy ML 
<* 2 <Ci) = 8 
Y = 2.8 dB 


AG 

33% important 
data 
rate4-2/£ 


Fig. 11 
P = 5.25. /V4tf = 1-7 
sec Example 4C 


2 level code: - 
152,66,761: 16-state 
rate 1/3 convolutional 
code, dfj - 12 
A 

parity check 
rf 2 (C 0 ) - min(12x2. 2x10) 
= 20 
r = 6.8dB 


2-level avtg - 
[3133] with 
puncturing rule 

[! i}"« h « 

16-state t rate 2/3 
code, dff ■ 5 
A 

parity check 

<* 2 <c 0 = 

min(5x8, 2x16. 64) = 32 
Y = 2.8 dB 


4H 

37.5% important 

dan 

rate4-l/L 


Fig. 10 
/* = 5.25. PAR = 1-76 
see Example 4C 


2-level code: - 
[2335]: 16-state 
rate 1/2 convolutional 
code, 4* » 7 
A 

parity check 
d 2 (Co) = min(7x2.2xl0) 
= 14 
T= 5.3dB 


2-level code: - 
rate 2/3 punctured 
convolutional code 
from Example 4G 
& 

16-state, rate 7/8 
punctured convolutional 
code with d N ~ 3 
**<C,)« 
min(40, 3x16, 64) =40 
Y - 3.76dB 
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TABLE 2 Cont'd. 



10 



Example 


Signal 
Constellation 

WWII 


Code C 0 for 

imtw'Mlaitt Kite 


CodeC, for less 
important bits 


4J 

43.75% important 
data 

| rate4+l/4-2/L 


Fig. 4 

P * 4.75. PAR m 19 
dHCl*. fl^) * 
I 8. if ab = erf 
[4, ifo6 * C d 


2-levcl code: - 
rate 3/4 convolution^ 
code from Example 4F 
A 

parity check 
</ 2 (C 0 ) = min(4x4. 2x8) 
- 16 

T" — ti. 1A ATt 
1 — O.JA Qjf 


3 -level code: - 
rate 1/2 convolutional 
code from Example 4 A 
A 

rate 3/4 convolutional 
code from Example 4F 
A 

parity check 
d*{C x ) = 7 
Y = 2.7 dB 


4K 

56.25% important 
| data 

rate4-2/L 


Fig. 14 
J> = 16^-, PAR = 1-63 

9. if c * / 
18. if 6c = If 
I 36. ifaftc = def 


3-level code: - 
rate 1/2 convolutional 
code from Example 4 A 
A 

rate 3/4 con volitional 
code from Example 4F 
A 

parity check 
d 2 (C 0 ) a min(63, 72. 72) 
= 63 T = 6.73 dB 


2-level code: - 
rate 3/4 convolutional 
code from Example 4F 
A 

parity check 
rf 2 (C|) = 16 
y = 0.78dB 


4L 

22.5% important 
data 

rate 3+7/8- VL 
(power penally) 
0.75 dB 


Fig. 12 
/» = 11, PAR » 1-86 
<f J (Q 0 .Q,) = 25 


[23,35] with 
puncturing rule 
[101001 1. 110010) 
to give 16-state 
rate 7/8 convolutional 
code with d a «= 3 
d\C 0 ) = 75 
r = 8.55 dB 


see Example 4D 
d 2 (C t ) = 14 
v = 1.27 dB 
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In these tables, P denotes the average power per dimension; PAR denotes the peak-to-average power 
ratio; d 2 denotes the squared Euclidian distance between the supersymbols represented by its arguments; r 
denotes the nominal coding gain for the more important bits; y denotes the nominal coding gain for the less 
important bits; and [g^gj is the generator matrix, in octal notation, for the convolutional codes indicated; L is 
the length of the parity check code. For non-uniform constellations, the degree of non-uniformity is determined 
by x. The tables also show the achievable gains as a function of x. 

In designing unequal error protection signaling schemes, such as those just presented in TABLES 1 and 
2, one typically mustf irst be given the values of certain parameters. These include (a) available channel band- 
width, (b) the worst-case channel SNR, (c) the number of classes of bits, (d) the percentage of bits in each 
class, (e) the desired quality of the final received signal under the worst case channel conditions, (f) acceptable 
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10 



15 



20 



40 



decoder complexity, and (g) peak-to-average power ratio. One can then proceed to design an unequal-error- 
protection scheme consistent with the given parameter values. 

Typically, one might begin by choosing the signal constellation to allow for about one overall bit of redun- 
dancy per symbol. The number of supersymbolsthat is needed is determined by the actual number of important 
bits per symbol. For example, if more than 25%, and less than 50%, of the bits are important and if the available 
bandwidth and required overall bit rate dictate, say, four information bits per symbol, then we will have to trans- 
mit one important bit per symbol. Assumina. further, that it 

for the important brts and that those bits will be used to select the supersymbols, then it may be reasonable 
to use a two-dimensional constellation having four supersymbols. Various of the constellations disclosed here- 
in, or any other desired constellation, can be used as the initial design choice. Advantageously, a constellation 
embodying the principles of the present invention may be used- One would then proceed to select codings to 
be used for the bit streams depending on the relative redundancies desired. If, upon analysis, it appears that 
the desired quality at the worst-case SNR is not achieved with the design arrived at to this point, other con- 
stellations-including constellations having different values of the parameter "X* as indicated in FIGS 7 and 
9-and other codes can be explored with a view toward seeing whether it can, in fact, be achieved. If this does 
not appear possible, one or more of the previously given constraints, such as acceptable decoder complexity 
may have to be relaxed. Other design criteria are conceivable as well as other parameters that may affect the 
choice of the code design. 

In accordance with a feature of the invention, an advantageous technique is provided for assigning the 
values of the bits that are used to select the symbols from each identified supersymbol to those symbols In 
accordance with that technique, a pair of symbols from respective different supersymbols are assigned to the 
same less-important-bit values if the distance between that pair of symbols is the minimum distance between 
any pair of symbols of those two supersymbols. Such a scheme is illustrated in FIG. 10, in which like in FIG 
4, each symbol is labelled with a b 2 ,b u bo set of values. Note, for example, that the symbols labelled 110 in 
25 each of the supersymbols Hoi. « 10 and all satisfy the aforementioned criterion. Such a labelling 
scheme--wh,ch is achievable to varying degrees, depending on the constellation and supersymbol geometries- 
-is advantageous in that it improves the probability that the less-important-bit values will be decoded properly 
even if an error is made in recovering the correct supersymbol sequence. Beyond this, it may be possible to 
achieve further benefit by similar judicious choice of bit assignments for those symbols which do not meet the 
30 above-ment.oned minimum distance criterion. This would need to be done, however, within the constraints that 
are im posed by any coding that is implemented for the symbols within the supersymbol. as was, in fact, the 
case of the example described above in conjunction with the constellation of FIG. 4 

The foregoing merely illustrates the principles of the present invention. For example, although two-dimen- 
s.onal constellations are shown, the invention can be used in schemes using constellations with more than 
35 two dimensions. 

It may also be noted that although the invention is illustrated herein as being implemented with discrete 
functional building blocks, e.g.. source coders, scramblers, etc.thefunctionsof anyoneormore of those build- 

™?^ S C "" be CarriSd OUt USin9 °" e ° r mcre a PP r °P riate Programmed processors, digital signal processing 
(DSP) chips, etc. 3 



Claims 

1 . Apparatus for channel coding successive groups of imk data bits associated with respective symbol in- 
« tervals, said apparatus comprising 

means (110. 114) for encoding during each said interval m of the bits of one of the groups to gen- 
erate a redundancy coded group of r bits, r > m. 

means (131) for identifying a particular one of 2'supersymbols of a predetermined channel symbol 
constellation as a function of the values of said r bits, each of said supersymbols being comprised of a 
so plurality of symbols of said constellation, and 

m eans (111, 115) for generating a signal representing a selected one of the channel symbols of 
the identified one supersymbol, the selection being performed as a function of the values of the other k 
bits of said one group, 

CHARACTERIZED IN THAT 

55 u u the minimum distance between the symbols within at least one of the supersymbols being a) less 

than the maximum intra-subset distance for said constellation and b) greater than the minimum distance 
between the symbols of the constellation as a whole. 
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The invention of claim 1 

CHARACTERIZED IN THAT 

sets of values of said second group of bits are assigned to the symbols of said constellation in such 
a way that a pair of symbols from respective different supersymbols are assigned to the same set of said 
values if the distance between that pair of symbols is the minimum distance between any pair of symbols 
of said respective different supersymbols and wherein said selection is further performed as a function 
of said assigned values. 

The invention of claim 1 

FURTHER CHARACTERIZED BY 

means (104) for generating said data bits by source coding input information in such a way that 
said m bits represent a portion of said information that is more important than the portion of said infor- 
mation represented by said k bits. 

The invention of claim 3 

CHARACTERIZED IN THAT 

said information is television information. 

The invention of claim 4 

CHARACTERIZED IN THAT 

said generating means encodes the other k bits of said one of the groups to generate a redundancy 
coded group of p bits, p > k and selects said individual symbol in response to said redundancy coded group 
of p bits. 

A method comprising the steps of 

encoding a first group of data elements to generate a first redundancy coded group of data ele- 
ments, 

identifying one of a plurality of supersymbols of a predetermined channel symbol constellation in 
response to the first redundancy coded group of data elements, each supersymbol being comprised of a 
respective plurality of symbols of the constellation, 

selecting an individual one of the symbols of the identified supersymbol at least in response to a 
second group of data elements, and 

applying to a communication channel a signal representing the selected symbol, 

CHARACTERIZED IN THAT 

the minimum distance between the symbols within at least one of the supersymbols being a) less 
than the maximum intra-subset distance for said constellation and b) greater than the minimum distance 
between the symbols of the constellation as a whole. 
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FIG. 7 
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FIG. 1 0 
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